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DETAILED ACTION 
Claim Rejections - 35 USC § 101 

1 . 35 U.S.C. 1 01 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

2. Claims 16-22 are rejected under 35 U.S.C. 101 because the claimed 
invention is directed to non-statutory subject matter. 

Independent claim 16 recites "A computer readable medium carrying one or 
more sequences of instructions for causing a processing system to..." that fails to meet 
the statutory requirement set forth in the Interim Guidelines. Annex IV (b) : 
(b) Nonfunctional Descriptive Material 

Nonfunctional descriptive material that does not constitute a statutory process, 
machine, manufacture or composition of matter and should be rejected under 35 
U.S.C. § 101. Certain types of descriptive material, such as music, literature, art, 
photographs and mere arrangements or compilations of facts or data, without any 
functional interrelationship is not a process, machine, manufacture or composition of 
matter. 



Application/Control Number: 10/708,905 Page 3 

Art Unit: 2621 

Claim 16 should be rewritten as a computer readable medium stored thereon 
computer executable instructions directed to performing the steps recited in claim 16. 
Claims 17-22 are dependent upon claim 16. 
Appropriate corrections to the claims are required. 

Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this country, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent. 

2. Claims 1, 15, 16, and 23 are rejected under 35 U.S.C. 102(a) as being 
anticipated by Tolku et al. (US 6549643 B1). 

Re claim 1, Tolku discloses a method of identifying key video frames in a 
sequence of image frames, each of said sequence of image frames containing a 
plurality of pixels, each of said plurality of pixels corresponding to a corresponding point 
of an area based on which said sequence of image frames are generated, said method 
comprising: determining a rate of change of visual content of each current frame from a 
corresponding reference frame, each of said current frame and said reference frame 
being comprised in said sequence of image frames (Toklu: Fig. 2B, step 212); and 
selecting said current frame as a key video frame (Toklu: Fig. 2B, step 218)if said rate 
exceeds a first threshold value (Toklu: Fig. 2B, step 214). 
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Re claim 15, Tolku discloses that said reference frame comprises an adjacent frame 
(Toklu: column 5, line 65, through column 6, line 7). 

r 

Claim 16 recites the corresponding computer readable medium containing a 
computer program for executing the method of claim 1, and, therefore, has been 
analyzed and rejected with respect to claim 1 above. 

Claim 23 recites the corresponding system for executing the method of claim 1 , 
and, therefore, has been analyzed and rejected with respect to claim 1 above. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 2-4, 6, 9-11, 13, 17-19, 21, 24-26, and 28 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Tolku et al. (US 6549643 B1) in view of Zhang et 
al. (US 7027513 B2). 

Re claim 2, Tolku discloses a majority of the features of claim 2, as discussed 
above in claim 1, and additionally that a current frame is selected as a key video frame 
if the current frame's motion exceeds a second threshold (Toklu: Fig. 2B, when the 
cumulative motion in steps 220, 221, and 222 exceeds a threshold, the frame is 
selected as a key frame in step 223), but does not specifically disclose determining a 
displacement magnitude of each moved pixel of said current frame compared to the 
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position in said reference frame and computing a . representative magnitude of said 
displacement magnitude for said moved pixels of said current frame. However, Zhang 
discloses a method for extracting key frames from video using a triangle model of 
motion based on perceived motion energy, where the average magnitude of the motion 
vectors for a particular frame is calculated (Zhang: column 9, lines 25-38), and the 
average magnitude is used to calculate the perceived motion energy (Zhang: column 9, 
lines 39-49). Since both Tolku and Zhang relate to selecting key video frames based on 
motion analysis, one of ordinary skill in the art at the time of the invention would have 
found it obvious to combine the triangle method of Zhang with the histogram analysis of 
Tolku in order to provide a uniform and consistent selection method that yields a proper 
number of key frames that are most representative of the video sequence content 
(Zhang: column 5, lines 34-37). The combined method of Tolku and Zhang has all of 
the features of claim 2. 

Re claim 3, the combined method of Tolku and Zhang discloses that said 
representative magnitude comprises an average of motion energy vector magnitude of 
said moved pixels of said current frame (Zhang: column 3, lines 57-67). 

Re claim 4, the combined method of Tolku and Zhang discloses that said rate is 
computed from said average motion energy vector magnitude (Zhang: column 3, line 
65, through column 4, linel). 

Re claim 6, the combined method of Tolku and Zhang discloses identifying a 
plurality of active pixels in said current frame, wherein a pixel is considered an active 
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pixel if a corresponding displacement magnitude is outside of a range, wherein only said 
plurality of active pixels are used by said computing (Toklu: Fig. 2C, step 231). 

Re claim 9, the combined method of Tolku and Zhang discloses enabling a user 
to specify one of a plurality of key video frames, wherein said plurality of key video 
frames are selected by said selecting (Zhang: Fig. 1, element 120; column 5, lines 43- 
44, indicate that the user may use the key frames to select the desired section of the 
video for display); and displaying said specified one of said plurality of key video frames 
(Zhang: Fig. 1, element 120; column 5, lines 43-44, indicate that the user may use the 
key frames to select the desired section of the video for display). 

Re claim 10, the combined method of Tolku and Zhang discloses displaying a 
prior key video frame and a next key video frame in relation to said specified one of said 
plurality of key video frames, wherein said prior key video frame and said next key video 
frame are comprised in said plurality of key video frames (Zhang: Fig. 1, element 120, 
key frames are displayed in a sequence). 

Re claim 1 1 , the combined method of Tolku and Zhang discloses generating a 
display indicating the manner in which said plurality of key video frames are 
interspersed in said sequence of image frames, wherein said enabling is based on said 
display (Zhang: Fig. 12, the key frames are shown along with their corresponding frame 
numbers). 

Re claim 13, the combined method of Tolku and Zhang discloses generating a 
display listing said plurality of key video frames, wherein said enabling is based on said 
display (Zhang: Fig. 1, element 120; column 5, lines 43-44). 
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Claim 17 has been analyzed and rejected wi 
Claim 18 has been analyzed and rejected wi 
Claim 19 has been analyzed and rejected wi 
Claim 21 has been analyzed and rejected wi 
Claim 24 has been analyzed and rejected wi 
Claim 25 has been analyzed and rejected wi 
Claim 26 has been analyzed and rejected wi 
Claim 28 has been analyzed and rejected wi 



h respect to claim 2 above, 
h respect to claim 3 above, 
h respect to claim 4 above, 
h respect to claim 6 above, 
h respect to claim 2 above, 
h respect to claim 3 above, 
h respect to claim 4 above, 
h respect to claim 6 above. 



5. Claims 5, 7, 8, 20, 22, and 27 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Tolku et al. (US 6549643 B1) in view of Zhang et al. (US 
7027513 B2) as applied to claims 2-4, 6, 9-11, 13, 17-19, 21, 24-26, and 28 above, 
and further in view of Ma et al. (US 20040088723 A1). 

Re claim 5, the combined method of Tolku and Zhang discloses a majority of the 
features of claim 5, as discussed above in claims 1-4, but does not specifically disclose 
that the first threshold and the second threshold are adjusted dynamically to ensure that 
a desired number of frames are selected as key video frames in a specified duration. 
However, Ma discloses a method for generating a video summary, where a binarization 
threshold is estimated in an adaptive manner (Ma: paragraph [0081]) when analyzing a 
video sequence for selecting key frames. Since Tolku, Zhang, and Ma relate to 
selecting key frames in a video sequence, one of ordinary skill in the art at the time of 
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the invention would have found it obvious to combine the attention modeling of Ma with 
the combined key frame selection method of Tolku and Zhang in order to create a 
representative video summary consisting of very short video clips, which contain the 
video immediately preceding and immediately following key frames that have been 
selected (Ma: Fig. 20). The combined method of Tolku, Zhang, and Ma has all of the 
features of claim 5. 

Re claim 7, the combined method of Tolku, Zhang, and Ma discloses that said 
range set by a distance of two times the variance from the mean of a distribution (Ma: 
paragraphs [0081]-[0082], the threshold is a function of the variance). 

Re claim 8, the combined method of Tolku, Zhang, and Ma discloses that said 
representative magnitude comprises an average of said active pixels (Ma: equation (12) 
and paragraph [0084]). 

Claim 20 has been analyzed and rejected with respect to claim 5 above. 

Claim 22 has been analyzed and rejected with respect to claim 7 above. 

Claim 27 has been analyzed and rejected with respect to claim 5 above. 

6. Claims 12 and 14 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Tolku et al. (US 6549643 B1) in view of Zhang et al. (US 7027513 B2) as 
applied to claims 2-4, 6, 9-11, 13, 17-19, 21, 24-26, and 28 above, and further in 
view of Sull et al. (US 20060064716 A1). 

Re claim 12, the combined method of Tolku and Zhang discloses a majority of 
the features of claim 12, as discussed above in claims 1-4, 6, and 9-11, but does not 
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specifically disclose that the display comprises a pie chart. However, Sull discloses 
techniques for navigating multiple video streams, where textual/visual information, such 
as a pie chart, may be displayed along with poster-thumbnails on the video selection 
screen for the user interface (Sull: paragraph [0307]). Since Tolku, Zhang, and Sull all 
relate to representative images for video sequences, one of ordinary skill in the art at 
the time of the invention would have found it obvious to combine the textual information 
of Sull with the key frame selection of the combined method of Tolku and Zhang in order 
to provide the user with more information, such as date and time of broadcast (Sull: 
paragraph [0307]), for improving the user's ability to quickly find the desired video 
segment (Zhang: column 5, lines 44-45). The combined method of Tolku, Zhang, and 
Sull has all of the features of claim 12. 

Re claim 14, the combined method of Tolku, Zhang, and Sull discloses that said 
display comprises a button, which when selected, causes said display to be generated 
(Sull: Figs. 6A and 6B, the thumbnail images act as buutons, so that when selected by 
the user, the corresponding video clip is displayed). 

Conclusion 

7. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure: 

a. Feature based hierarchical video segmentation 

Bozdagi et al. (US 6493042 B1) 
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b. Method of selecting key-frames from a video sequence 
Wilf etal. (US 7184100 B1) 

c. System for automatic video segmentation and key frame extraction for 
video sequences having both sharp and gradual transitions 

Zhang et al. (US 5635982 A) 

Contact 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Christopher Findley whose telephone number is (571) 
270-1 199. The examiner can normally be reached on Monday-Friday 7:30am-5pm, 
Alternate Fridays off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on (571) 272-7418. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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